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SYSTEM AND METHOD FOR IMAGE TAMPER DETECTION VIA THUMBNAIL HIDING 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

5 The present invention relates to the field of digital image 

tamper detection. More particularly, the invention deals with a 
system and method of digital image tamper detection that can 
effectively detect image manipulations and their locations within 
the image but is tolerant of the effects of low-level image 
10 compression and additive channel noise, i.e., a semi-fragile 
technique . 

2. Description of Related Art 

Image tamper detection techniques are well known in the art as 
a method used to detect modification of an image from its original 
15 state. 

A range of tamper detection techniques has been described, 
varying in degree from fragile techniques, that can detect the most 
minute alterations of an image, to more robust techniques, that are 
tolerant of significant modifications of an image. Semi-fragile 
20 techniques lie between these extremes and are capable of detecting 
significant modifications while, at the same time, tolerating minor 
alterations, such as those induced by low levels of lossy 
compression or channel noise. 
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Approaches to semi -fragile tamper detection have been proposed 
in the literature, all of which employ some variation of an 
extracted image signature. The concept of semi-fragile tamper 
detection is described by M. Schneider and S. Chang, Proceedings of 
5 the IEEE International Conference on Image Processing, pages 227- 
230, Lausanne, Switzerland, September 1996. Schneider and Chang 
proposed a semi -fragile technique of tamper detection that extracts 
a content-based signature of the image as intensity histograms from 
blocks of image pixels ♦ This content-based signature is then 
10 embedded within the original image using any one of a variety of 
known watermarking techniques. This technique is robust to a 
certain level of lossy image compression. 

Another scheme for semi-fragile tamper detection is described 
by L. Xie and 6. Arce in "A Watermark for Digital Images," 
^15 Proceedings of the IEEE International Conference on Image 
i Processing, Chicago, IL, October 1998. Xie and Arce describe a 
scheme of embedding edge information extracted from the original 
image within the low-order coefficients of a wavelet transform. 

S. Bhattacharjee and M. Kutter, in "Compression Tolerant Image 
20 Authentication," Proceedings of the IEEE International Conference 
on Image Processing, Chicago, IL, October 1998, describe another 
compression tolerant tamper-detection scheme. Their scheme 
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extracts perceptually interesting feature points that are not 
embedded within the image but maintained separately. 

In H. Wu and B. Liu, "Watermarking for Image Authentication/' 
Proceedings of the IEEE International Conference on Image 
5 Processing, Chicago, IL, October 1998, a technique is presented 
that invisibly embeds within the original image a visually 
meaningful watermark, along with a set of simple features, by 
altering coefficients that are indexed into a look-up table of 
frequency domain coefficients . 

10 In addition to approaches that are described in the 

literature, several patents teach devices and methods for image 
tamper detection and/or authentication. An image tamper detection 
and/or authentication process is disclosed by Ward, in U.S. Pat. 
No. 5760386, in which the image of the holder of an identification 

15 document is stored, in highly compressed form, in a magnetic medium 
dispersed invisibly within a visible print of the holder that is 
part of the document or within the body of the identification 
document itself. When the document is scanned magnetically at the 
place where identification is being authenticated, this image is 

20 decompressed and displayed in order to confirm that the holder of 
the document is the person shown and that the document has not been 
tampered with. The entire content of the original image is used in 
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Ward's process. This tamper detection approach is not restricted to 
certain acquisition devices. 

Shimizu f et al., U.S. Pat. No. 6005936, disclose a digital 
camera device and method for embedding an extracted image signature 
5 in a digital image. In response to the digital signal of the 
image, a digital camera having a region-dividing unit divides the 
digital image into first and second regions. Authentication 
information is generated in the form of a hash value from data in 
the first region and this information is then encrypted using a 

10 secret key, which differs for each camera and is held within the 
camera itself. The encrypted hash value is then embedded in the 
second image region, and the first and second regions are then 
combined to form a combined image. An alteration detecting system 
is also disclosed in which an authenticator uses a public key 

15 corresponding to the camera's secret key to decrypt the hash value. 
The original division of the image is detected and the hash value 
is calculated anew and compared with the decrypted hash value to 
accomplish authentication of the image. This approach uses only 
part of the original image for authentication, i.e., the first 

20 image region, and is restricted to a particular image acquisition 
device , i.e., specially equipped digital cameras . 

Friedman, U.S. Pat. No. 5499294, discloses a digital camera 
equipped with a processor for generating a digital signature by 
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hashing an image file using a predetermined algorithm and 
encrypting the hashed file with a private key stored in the 
camera's processor. The encrypted image may be decrypted using a 
public key that is stored in the camera's housing. Both the image 

5 file and the digital signature are stored individually (not 
embedded one within the other) but in such a way that they will be 
available together. For authentication purposes only, the public 
key is used to decrypt the digital signature for comparison with a 
newly created hash of the entire image. This tamper detection 

10 approach is restricted to certain acquisition devices, i.e., 
specially equipped digital cameras. It is also possible for the 
digital signature and the original image file to be separated from 
one another by a malicious attacker intent on defeating this 
security technique. 

15 Schipper, et al., U.S. Pat. No. 5987136, disclose an apparatus 

for producing a self-authenticating visual image of a selected 
view, using a digital image forming means such as a digital camera, 
together with a position determining system that provides position 
information. The position information is incorporated in the 

20 digital image by altering pixel bit values in a selected 
authentication pattern of the pixel array associated with the 
digital image. A set of polygons is used as the authentication 
pattern, wherein each polygon contains at least one pixel from the 
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selected subset of the pixel array. The authentication pattern is 
represented by a key or ordered sequence of keys and may be 
encrypted and either stored with or as a part of the digital image. 
This tamper detection approach is restricted to certain acquisition 
5 devices , i.e., specially equipped digital cameras . If the 
authentication pattern is stored separately from the image, there 
is the possibility of its destruction by a malicious attacker. 

Squilla, et al., U.S. Pat. No. 5898779, disclose a public key 
encryption system for authenticating an image using a digital 

10 camera which has a private key embedded in it that is unique to the 
digital camera. A known public key, uniquely based on the private 
key, is used to decrypt digital image data encrypted with the 
private key in order to establish authenticity of an image. A 
digital signature is produced by the camera using one or more 

15 patterns taken from an active area of the image and input to a 
predetermined hash function. The hashed output is then encrypted 
employing the embedded private key. The digital signature and 
location of the active area are stored together with the image but 
not within the image. This tamper detection approach is restricted 

20 to certain acquisition devices, i.e., specially equipped digital 
cameras, and is subject to destruction of both the digital 
signature and the location of the active area by a malicious 
attacker . 
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Murphy, et al., U.S. Pat. No. 5799082, disclose an apparatus 
for capturing and authenticating a visual image of a selected view, 
using a digital image forming means, such as a digital camera, 
together with a position determining system that provides position 
5 information. Any suitable overlay pattern of a selected subset of 
the array of image pixels may be used to incorporate the position 
information in the digital image by altering the pixels lying 
within this pattern. The position information may be encrypted, 
using an encryption key based on position information, and may be 

10 stored as part of the digital image. Optionally, position 
information includes the distance from the digital camera to the 
selected object in the selected view. Murphy's tamper detection 
approach is restricted to certain image acquisition devices, i.e., 
specially equipped digital cameras, and the authentication 

15 information is susceptible to destruction by a malicious attacker 
if it is stored separately and not embedded in the image. 

Tamper detection techniques known in the art have various 
vulnerabilities and limitations. In several techniques the tamper 
detection information is developed using only a part of the image 

20 and if a different part of the image is modified, this approach 
cannot detect the tampering. In other techniques the tamper 
detection information is easily separated from the image because it 
is stored with but separate from the image. Many known techniques 
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are restricted to certain acquisition devices. Many known 
techniques cannot indicate where in the image the detected 
tampering has occurred. 

SUMMARY OP THE INVENTION 
5 According to the present invention , there is provided a semi- 

fragile tamper detection system and method that overcomes the 
above-noted prior art shortcomings. More particularly , the semi- 
fragile tamper detection system and method of the present invention 
hides a low-resolution version of the entire original image within 

10 the original image , is acquisition device independent, and 
signifies the image areas in which detected tampering has occurred. 

The semi-fragile tamper detection scheme of the present 
invention uses data hiding techniques to embed a low-resolution 
version of an original image within the image itself to form a 

15 marked image. A low-resolution version of an image is defined as a 
thumbnail of that image. Any data hiding technique can be used that 
is resilient to the effects of both image compression and low 
levels of transmission channel noise. 

With proper selection of a data hiding technique, the hidden 

20 information (thumbnail) is recoverable even if the image has been 
compressed via low levels of image compression, e.g., JPEG, or 
exposed to additive transmission channel noise. Gross alterations 
in a transmitted marked image may then be detected by extracting 
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the embedded thumbnail and comparing it with a newly computed 
thumbnail of the received marked image. If the two thumbnails are 
sufficiently similar, it can be concluded that no tampering has 
occurred and the image is authenticated. Alternatively , if the 
5 thumbnails are not sufficiently similar , it can be concluded that 
the image has been manipulated and a tamper alert can be issued. 

An image thumbnail can be constructed in a number of ways, 
including, low-pass filtering followed by decimation and wavelet 
decomposition. Data hiding can be accomplished by a variety of 
10 data hiding techniques such as Spread Spectrum Image Steganography 
(SSIS) . 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a flow chart which illustrates a general tamper 
detection operating scenario. 
15 Fig. 2 is a flow chart which illustrates a tamper detection 

operating scenario according to the present invention. 

Fig. 3 illustrates a noise-free, unmodified line drawing 
corresponding to an image of an air field taken from space. 

Fig. 4 illustrates a line drawing of a marked image resulting 
20 from application of the present invention to the image illustrated 
in Fig. 3, i.e., a thumbnail of the original image is embedded in 
the original image. 
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Fig. 5a illustrates the marked image of Fig. 4 compressed with 
JPEG compression with a quality factor of 90 . 

Fig. 5b illustrates the difference between a thumbnail 
extracted from a decompression of the image of 5a and the original 
5 thumbnail . 

Fig. 5c illustrates malicious tampering of the image of Fig. 

5a. 

Fig. 5d illustrates results of semi-fragile tamper detection 
according to the present invention applied to Fig. 5c. 
10 Fig. 6 illustrates a histogram of the unenhanced difference 

image illustrated in Fig. 5b, the compressed marked image. 

Fig. 7 illustrates a histogram of the unenhanced difference 
image illustrated in Fig. 5d, the modified marked image. 

Fig. 8a illustrates the superimposition of noise on the image 
15 of Fig 5a. 

Fig. 8b illustrates the difference image of Fig. 5a and Fig. 
8a, i.e. , the superimposed noise. 

Fig 8c illustrates the superimposition of noise on the 
modified marked image of Fig. 5c. 
20 Fig. 8d illustrates the result of applying semi-fragile tamper 

detection according to the present invention to the image of Fig. 
8c. 
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Fig. 9 is a block diagram which illustrates an embodiment of 
the image tamper detection according to the present invention as an 
apparatus . 

Fig. 10 is a block diagram which illustrates an embodiment of 
5 thumbnail processing according to the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
The following embodiments of the present invention are 
provided for illustrative purposes only. 

Referring now to the flow chart of Fig. 1, a general tamper 
10 detection operating scenario is illustrated. In step 10, a sender 
uses a tamper detection mechanism and a key to embed a tamper mark 
within an image. In step 11, the marked image is then compressed 
or exposed to additive channel noise during transmission to a 
recipient, thereby causing distortion in the marked image during 
15 transmission. While en route to a recipient, the image may also be 
intercepted by a malicious party who may employ image manipulation 
techniques to modify the image information. This distorted, 
modified, and marked image is then passed along to the recipient, 
who has no knowledge of the interception or manipulation. Upon 
20 receipt of this image , in step 12 , the recipient extracts the 
tamper detection mark and uses it in step 13 to determine if the 
image has been altered. If altered, a tamper alert is emitted in 
step 14 or the image is authenticated in step 15. 
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The semi -fragile detection system and method of the present 
invention is illustrated in the flow chart of Pig. 2 with the 
primary functions of the system and method reflected in the 
following equations: 
5 (1) In sub-process 21, the thumbnail of the entire 

original image is computed. For demonstration purposes, consider 
an original N x N image, I, where the thumbnail is computed as: 

T = (t(j):j=0,l, ... , M}, M=(N/2 n ) 2 . 

10 

This thumbnail contains the lowest order coefficients of an n-level 
wavelet decomposition, W, such that 



T = W(X,n) . 

15 

The user may select n to ensure that all important image features, 
those for which tamper detection is desired, are visible within the 
thumbnail. A secondary consideration in the selection of the 
variable n is the payload capacity of the original image. 
20 ( 2 ) The marked image, 6, is constructed by the data hiding 

encoder in step 22, that embeds T into the original image governed 
by a key k: 
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G = tt(I,T,k) 



The choice of 0-C is made so that the size and dynamic range of the 
resultant marked image do not vary from the original image. 
5 (3) The marked image may be exposed to various distortions, 

including image compression and noise from the transmission channel 
in process 23. Furthermore, a malicious attacker may manipulate 
the image in step 24. The present claimed invention detects image 
manipulation as tampering while neglecting effects of both modest 
llO image compression and channel noise. 

(4) The marked image received by the recipient is denoted as 
G and is a version of G that may have been distorted and 

maliciously manipulated. From G, the embedded thumbnail of the 
original image, T, is extracted in step 25: 

1J15 

T = JT^Gjk) . 



(5) A new thumbnail is created from the received image in 
step 26: 

20 

T = W(G,n) . 
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(6) The two thumbnails are compared for similarity by taking 
the absolute difference of corresponding inverse wavelet transforms 
in step 27: 

5 D = IW^T^) - W'^T^n) | . 

(7) In the locations where D is large, the thumbnails are 
judged not sufficiently similar, it can be assumed that tampering 
has occurred, and a tamper alert is emitted 28. Where D is small 

10 the thumbnails are judged sufficiently similar, the effects are 
attributed to image compression and/or low- level channel noise and 
the image is authenticated in step 29. If D is approximately equal 
to zero, the thumbnails are deemed sufficiently similar, the image 
is judged not to have been altered in a significant manner, and the 
J15 image is authenticated in step 29. 

In one exemplary embodiment of the present invention the data 
hiding technique used is Spread Spectrum Image Steganography 
(SSIS) . However, any technique can be used that meets the data 
hiding requirements of concealing a thumbnail in the original image 
20 so that it cannot be detected and neither the size nor the dynamic 
range of the original image are changed. In this exemplary 
embodiment, thumbnail computation is accomplished using wavelet 
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decomposition. However, any technique can be used that meets the 
thumbnail requirement of creating a low resolution counterpart of 
the entire image. 

Fig. 3 illustrates an original image and Fig 4 illustrates a 
5 marked image resulting from the semi -fragile system and method of 
the present invention applying a three-level wavelet decomposition 
to this original image to derive a thumbnail and then embedding 
this thumbnail in the original image using SSIS with a rate of 1/6 
error correcting code and an embedded signal power of 60. That is, 
10 the marked image should look very much like the original image with 
a mean-squared error of 60 and a peak signal-to-noise ratio of 
303.3 dB. 

Referring now to Fig. 5a, the marked image illustrated has 
been compressed with JPEG compression with a quality factor of 90 

15 to result in a compressed marked image of 2.89 bpp. To illustrate 
the semi-fragile technique of the present invention, the 
compressed, marked image of Fig. 5a is decompressed, the thumbnail 
extracted and the thumbnail compared to a newly computed thumbnail 
for the received image illustrated in Fig. 5a. The difference 

20 image between the reconstructed and newly created thumbnails is 
illustrated in Fig. 5b. From this difference image, the subtle 
changes due to image compression can be seen, but gross 
abnormalities are not present. 
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Fig. 5c illustrates malicious tampering by manipulating the 
compressed marked image of Fig. 5a by removing several planes on 
the tarmac and in the lower left image quadrant. Fig. 5c 
illustrates the received image. Figure 5d illustrates the result 
5 of applying the semi-fragile tamper detection technique of the 
present invention to the modified compressed marked image of Fig. 
5c. The difference between the thumbnail extracted from the 
received image and the newly created thumbnail for the received 
modified compressed image is illustrated in Fig. 5d. The 
□ 10 significant differences between the two are evident in the clouds 
y that occur in the locations of the removed planes. The effects of 

\T compression are still present in this difference but some are 

\-Z obscured by the large difference caused by the manipulation. 

- Fig. 6 illustrates a histogram of the difference image used to 

3 15 produce Fig. 5b, the compressed marked image. Fig. 7 illustrates a 
C histogram of the difference image used to produce Fig. 5d, the 

modified compressed marked image. Large intensity values are 
present in the modified compressed marked image difference, e.g., 
135, while the difference values due to lossy compression are very 
20 small, e.g., 8. As a result of this phenomenon, simple 
thresholding of the difference image is used in one embodiment of 
the present invention to provide automatic tamper detection. 
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Finally, as illustrated in Fig. 8a, adding channel noise with 
a bit error rate equal to 10" 4 to a marked image results in a 
slightly altered noisy image. The thumbnail for this marked image 
is extracted and compared to a newly constructed thumbnail for this 
5 image and the difference image that results is shown in Fig. 8b. 
When the image illustrated in Fig. 8a, a noisy marked image, is 
compressed and maliciously manipulated, it becomes the compressed 
noisy modified marked image illustrated in Fig 8c. Applying semi- 
fragile tamper detection according to the present invention yields 

10 the difference image illustrated in Fig. 8d. In this difference 
image, noise is not readily visible while significant alterations 
are indicated by the clouds. 

From the foregoing it will be obvious to one skilled in the 
art that numerous modifications and variations can be made without 

15 departing from the spirit and scope of the novel aspects of the 
current invention. For example, Fig. 9 is a block diagram of a 
multiprocessor apparatus with a shared memory that embodies the 
thumbnail computation process of the present invention. Fig. 10 
shows another example, illustrating a block diagram for an 

20 embodiment that employs individual units to perform thumbnail 
processing. It is to be understood that no limitation with respect 
to the specific embodiments illustrated is intended or should be 
inferred. 
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